Experimental realization of quantum games on a quantum computer 
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We generalize the quantum Prisoner's Dilemma to the case where the players share a non max- 
imally entangled states. We show that the game exhibits an intriguing structure as a function of 
the amount of entanglement with two thresholds which separate a classical region, an intermediate 
region and a fully quantum region. Furthermore this quantum game is experimentally realized on 
our nuclear magnetic resonance quantum computer. 
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In 1982, Feynman[|l[ observed that quantum mechan- 
ical systems have an information-processing capability 
much greater than that of classical systems, and could 
thus potentially be used to implement a new type of 
powerful computer. Three years later DeutschQ de- 
scribed a quantum-mechanical Turing machine, showing 
that quantum computers could indeed be constructed. 
Although the theory is well understood, actually build- 
ing a quantum computer has proved extremely diffi- 
cult. Up to now, only three methods have been used 
to demonstrate quantum logical gates: Trapped ions||, 
cavity QED[Q and NMR||. Of these methods, NMR 
has been the most successful with realizations of quan- 
tum teleportation||, quantum error correction^, quan- 
tum simulation quantum algorithms^) and others []lo|| . 
In this Letter, we add game theory|llJ to the list: quan- 
tum games can be experimentally realized on a nuclear 
magnetic resonance quantum computer. 

Recently a new application of quantum information to 
game theory has been discovered [p[ [u| [lj, |j| (L7|- 
Game theory is an important branch of applied math- 
ematics. It is the theory of decision-making and con- 
flict between different agents. Since the seminal book of 
Von Neumann and Morgensternjl^], modern game theory 
has found applications ranging from economics through 
biology p9|, p0| . In the process of a game, whenever a 
player passes his decision to other players or the game's 
arbiter, he communicates information. Therefore it is 
natural to consider the generalization when the informa- 
tion is quantum, rather than classical) 12 [l3| . It should 
also be noted that many problems in quantum informa- 
tion theory can be considered as quantum games, for in- 
stance quantum cloning quantum cryptography |p2| 
and quantum algorithms |l3) . 

The Prisoner's Dilemma is a famous game in classical 
game theory and has been extended into quantum do- 
main by Eisert et a/.[p2|. Their work was based on the 
maximally entangled state. In this Letter, we general- 
ize the quantum Prisoner's Dilemma to the case where 
the players share a non maximally entangled states. We 
show that the game exhibits an intriguing structure as 
a function of the amount of entanglement. In addition 
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FIG. 1: The setup for the two-player quantum game. 



we have realized this quantum game on our nuclear mag- 
netic resonance quantum computer. We believe that it is 
the first explicit physical realization of such a quantum 
game. 

Let us now briefly recall the quantum Prisoner's 
Dilemma presented in Refjl2|. There are 2 players, 
the players have 2 possible strategies: cooperate(C) and 
defect(Z)). The payoff table for the players is shown in 
Table |[ Classically the dominant strategy for both play- 
ers is to defect (the Nash Equilibrium) since no player 
can improve his/her payoff by unilaterally changing his 
own strategy, even though the Pareto optimal is for both 
players to cooperate. This is the dilemma. In the quan- 
tum version, see Figjl], one starts with the product state 
\C) \C). One then acts on the state with the entangling 
gate J to obtain |^) = J\CC) = l/V2(\CC) +i \DD\). 
The players now act with a local unitary operator U a 
and Ub on their qubit. Finally the disentangling gate 
J + is carried out and the system is measured in the com- 
putational basis, giving rise to one of the four outcome 
\CC),\CD),\DC),\DD). If U A and U B are restricted to 

the classical strategy space = I,D = iSy^j , then one 
recovers the classical game. If one allows quantum strate- 
gies of the form 



TABLE I: Payoff matrix for the Prisoner's Dilemma. The 
first entry in the parenthesis denotes the payoff of Alice and 
the second of Bob. 
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FIG. 2: Alice's payoff for 7 = r y thl /2. In this and the following 
two plots, we have chosen a parametrization such that the 
strategies Ua and Ub each depend on a single parameter t G 
[-1, 1]: Ua = U (U, 0) for t G [0, 1] and Ua = U (0, -tw/2) 
for t G [—1,0] (same for Bob). Cooperation C corresponds to 
the value t = 0, defection D to t — 1, and Q to t — —1. 
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with 6 1 ^ 7r and 0^0^ 7r/2, then there exists a new 
Nash Equilibrium, label Q ® Q, with the payoff (3, 3). It 
has the property of being Pareto optimal, therefore the 
dilemma that exists in the classical game is resolved. It 
was pointed out in Ref|l2| that if one allows any local 
operations, then there is no longer a unique Nash Equi- 
librium. 

In the present letter we generalize Eisert et.al.'s scheme 
by taking the entangling operation to have the form 
=J\CC)= cos( 7 /2) I CC) + isin( 7 /2) \DD), where 
7 G [0,7r/2] measures the entanglement of the initial 
state. We shall restrict ourselves to strategies of the 
form of eq(l). We will show that an intriguing struc- 
ture emerges as 7 is varied from (no entanglement) to 
7r/2 (maximally entanglement), namely the game has two 
thresholds, 7 t/ll = arcsin y^l/5 and 7^2 = arcsin \j2jh. 
Fig.^ indicates Alice's expected payoff for 7 = j thl /2. 

In this case the game has features similar to the 
separable game with 7 = 0, see Ref[|l2j. Indeed for 
0^7^ Ithi' the quantum game behaves "classically", 
i.e. the only Nash Equilibrium is D ® D and the pay- 
offs for the players are both 1, which is the same as in 
the classical game. Fig.|| shows Alice's expected pay- 
off with 7 = (j thl + 7 i/l2 )/2. Assuming Bob chooses 
D = U(n, 0), Alice's best strategy is Q = U(0, tt/2) with 
$a{Q,D) = 5 sin 2 7; while assuming Bob's strategy is 
Q, Alice's optimal reply is D with $a(D, Q) = 5 cos 2 7. 
Since the game is symmetric, the same holds for Bob. 
Thus, D ® D is no longer a Nash Equilibrium because 
each player can improve his/her payoff by unilaterally 



FIG. 3: Alice's payoff for 7 = ( 7(W + 7tfe2 ) /2. The 
parametrization is chosen as in FigM 



deviating from the strategy D. However, two new Nash 
equilibria Q <£> D and D ® Q appear. This feature 
holds for 7 t/ll < 7 < 7 4/l2 - Indeed, $a{U(9 7 (f>), D) — 
sin 2 (6»/2) + 5 cos 2 (9/2) sin 2 sin 2 7 and % A (U(0,(t)),Q) = 
4 - cos6» + (-3 + 2cos0 - cos 2 (6»/2) cos2</f>) sin 2 7, 



hence $ A (U(6,<p),D) 



sm 7 



i(Q,D) and 



$a(U(0,4>),Q) < 5 cos 2 7 = $ A (D,Q) for all 6 G [0,tt] 
and <j) G [0,tt/2]. Analogously $ b (D,Ub) < $b(D,Q) = 
5sin 2 7 and % b {Q,Ub) < %b{Q,D) = 5cos 2 7 for all U B . 
So D (g) Q and Q ® D are both Nash Equilibria, with the 
feature that the Payoff of the player who adopts strategy 
D is better than that of the player who adopts Q. Thus 
in this regime the quantum game does not resolve the 
dilemma. But for 7 > "f th2 quantum strategies resolve 
the dilemma. In FigHwe depict Alice's payoff as a func- 
tion of the strategies U A and U B with 7 = (j th2 +n/2)/2. 
This figure is similar to the one for the maximally entan- 
gled game in Rcf |l2j . It can be shown that Q <g> Q is a 
unique equilibrium not only for 7 = (^ th2 + tt/2)/ 2 but 
also for any 7 G [7^2, 7r /2]- Hence a novel Nash Equilib- 
rium Q®Q arises with payoff $ A {Q, Q) — §b(Q,Q) = 3, 
which has the property of being Pareto optimal . The 
dilemma that exists in the classical game is removed as 
long as the game's entanglement exceeds the threshold 
Ithi = arcsm -\/2/5 ~ 0.685, even though the game's ini- 
tial state is not maximally entangled. 

Fig.|5| indicates Alice's payoff as a function of the pa- 
rameter 7 when both players resort to the Nash Equilib- 
rium. The two thresholds are analogous to phase tran- 
sitions. When the amount of entanglement is less than 
the smaller threshold, one is in a classical region. When 
the amount of entanglement lies between the two thresh- 
olds, one is in a transition region between classical and 
quantum behavior. The last domain is the fully quantum 
region. It is surprising that in the transition region, both 
Nash Equilibria result in an unfair game, even though the 
structure of the game is symmetric with respect to the 
interchange of the two players. We think that the reasons 




FIG. 4: Alice's payoff for 7 = (j th2 + tt/2) /2. The 
parametrization is the same as Figjij. 



FIG. 5: The expected payoff for Alice as a function of the 
measure of the parameter 7 when both players resort to Nash 
Equilibrium. The line correponds to theoretic calculation and 
the cross to the experimetal results. For y thl < 7 < j th2 i the 
dashed line and the doted line represent Alice's payoff when 
the Nash Equilibrium is D ® Q and Q ® D repectively. 



for the asymmetry are: (i) Since the definition of Nash 
Equilibrium allows multiple Nash Equilibria to coexist, 
the solutions may be degenerated. Therefore the defini- 
tion itself allows the possibility of such an asymmetry. 
This situation is similar to the spontaneous symmetry 
breaking; (ii) If we consider the two Nash Equilibria as 
a whole, they are fully equivalent and the game remains 
symmetric. But finally, the two players have to choose 
one from the two equilibria. This also causes the asym- 
metry of the game. 

This quantum game was implemented using our two 
qubit NMR quantum computer, described in Ref . [p3| . 
This computer uses the two spin states of 1 H nuclei 
of partially deuterated cytosinc in a magnetic field as 
qubits, while radio frequency (RF) fields and spin-spin 
couplings between the nuclei Jab = 7.17Hz are used 
to implement quantum logic gates. Experimentally, we 
performed nineteen separate sets of experiments with 
the entanglement of the player's qubits given by 7 = 
?i • tt/36 (n = {0, 1, 2, • • • , 18}). The 7 = (n = 0) cor- 
responds to Eisert et aZ.'s separable game and 7 = n/2 
(n = 18) corresponds to their maximally entangled quan- 
tum game. In each set, the full process of the quantum 
game shown in Fig.|l| was executed. The details of the 
process are as follows: (1) The quantum game starts with 
the computer in the unentangled pure state |CC), but 
with an NMR quantum computer it is impossible to be- 
gin in a true pure state. Using the methods of Cory et 
q/.|2^| it is, however, possible to create an effective pure 
state, which behaves in an equivalent manner. (2) The 
initial entangled state is obtained by applying the entan- 
gling gate J = exp{i~f£> ® D/2} which was performed 
with the pulse sequence shown in Fig.g where the time 
period t = "//(ttJ A b)- 

(3) Players Alice and Bob execute their strategic moves 
(the Nash equilibrium) described as local unitary opera- 
tions Ua®Ub- As shown above, Ua <S> Ub is determined 
by the value of 7 = nJt = n ■ 7r/36. Experimentally, 



D®D (0 < 7 < j thl ,i.e. n = {0,1,2,3,4,5}) was imple- 
mented using a non-selective 180° pulse; D <g>Q (Q ® D) 
{ithi ^ 7 ^ lthi^- e - n = {6,7}) was implemented 
by performing a selective 180° pulse on Alice's (Bob's) 
qubit, while a selective pulse sandwich 90° — 180° — 90° 
was performed on Bob's (Alice's) qubit; and Q <£> Q 
(lth2 ^ 7 ^ 7r/2,z.e. n — {8,9, •■■ ,18}) was imple- 
mented using a composite non-selective pulse sandwich 
90° y - 180° - 90°. (4) Finally, the disentangling gate 

J + = exp{—i-fD®D/2} (the inverse of J) is applied be- 
fore the measurement. The pulse sequence to implement 
J+ is the same as in Fig.|| except for t = (2tt— j)/(n Jab)- 
Thus the final state |V>/) = V J j(Ua,Ub)^ of the game 

prior to measure is given by |^/) = J + {Ua®Ub) J \CC). 

In NMR experiment, it is not practical to determine 
the final state directly, but an equivalent measurement 
can be made by so-called quantum state tomography J^. 
The readout procedure consists of applying a sequence 
of RF pulses, measure the resulting induction signal, 
Fourier transform to get the spectra, and integrate to get 
the areas of the resonance peaks. By applying nine differ- 
ent pulse sequences (no rotation, rotation about x, and 
about y , for each of the spins), the elements in the den- 
sity matrix were sampled, allowing a least-squares proce- 
dure to recover the density matrix p from the data. Then 
the expected payoff was determined using the numerical 
values of the payoff table of Prisoner's Dilemma by the 
%A = 3Pcc+5Pdc+Pdd and $ s = 3P C c+5P C d+Pdd, 
where P aa > = (aa'\ p\aa'} is the probability of finding 
the eigenstate \aa') (with J2a,c?'e{C,D} p <?°' = 1 )- 

All experiments were conducted at room temperature 
and pressure on Bruker Avance DMX-500 spectrometer 
in Laboratory of Structure Biology, University of Science 
and Technology of China. Alice's payoffs as a function 
of the parameter 7 (the measure of entanglement) in our 
NMR experiments are shown in Fig.^|. The computations 
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FIG. 6: NMR pulse sequece used to implement the entangling 
gate J. Narrow boxes correspond to 90° pulses, whereas wide 
boxes are 180° pulses; the upper and lower lines refer to the 
nuclear spins corresponding to Alice's and Bob's qubits, re- 
spectively; the phase of each pulse is written above it. 



shown in Fig.JT] took less than 300 milliseconds, which 
was well within the the decoherence time T 2 rs 3s. The 
relationship between player's payoff and the parameter 7 
in the quantum game is clearly seen in Fig.||, with good 
agreement between theory and experiment. The relative 
error is less than 8%. The errors are primarily due to 
inhomogeneity of magnetic field, imperfect 90° and 180° 
pulses, and the variability over time of the measurement 
process. 

In summary, it was shown in Ref.[[l2| that the classi- 
cal Prisoner's Dilemma can be generalized into a quan- 
tum game, and that when a maximally entangled state 
is employed the dilemma disappears. We used the same 
physical model as Eisert et al, but introduced a new pa- 
rameter 7, which measures the amount of entanglement 
in the quantum game. As 7 varies, novel features appear: 
there are two thresholds, j thl and j th2 , which separate 
the classical region, an intermediate region where 2 Nash 
Equilibrium coexist, and a fully quantum region where 
the dilemma disappears. The fact that the dilemma can 
be removed as long as the game's entanglement exceeds 
a certain threshold 7 t/l2 , is very much as in quantum 
cryptography and computation, where the superior per- 
formance of the quantum system depends strongly on the 
amount of entanglement. Furthermore, we realized this 
scheme experimentally on our two-qubit ensemble quan- 
tum computer. These experimental results demonstrate 
how a NMR quantum computer can load an initial state, 
enable each player to perform his/her quantum strate- 
gic moves, and readout the payoffs. This reveals a new 
domain of application for quantum computers. 

Note added: Since this work was carried out we 
have generalized it in three ways: first we have consid- 
ered the correlations between entanglement and quantum 
games for different sets of strategies , second we have 
considered three-player entanglement enhanced quantum 
games [|D and finally we analyzed how the thresholds 
Ithi ' Ithi vary when the parameters in the payoff ta- 
ble are changed pcf. 
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